Least third-order cumulant method with adaptive regularization parameter selection for neural networks
نویسندگان
چکیده
منابع مشابه
Regularization Parameter Selection for Faulty Neural Networks
Regularization techniques have attracted many researches in the past decades. Most focus on designing the regularization term, and few on the optimal regularization parameter selection, especially for faulty neural networks. As is known that in the real world, the node faults often inevitably take place, which would lead to many faulty network patterns. If employing the conventional method, i.e...
متن کاملDistributed Incremental Least Mean-Square for Parameter Estimation using Heterogeneous Adaptive Networks in Unreliable Measurements
Adaptive networks include a set of nodes with adaptation and learning abilities for modeling various types of self-organized and complex activities encountered in the real world. This paper presents the effect of heterogeneously distributed incremental LMS algorithm with ideal links on the quality of unknown parameter estimation. In heterogeneous adaptive networks, a fraction of the nodes, defi...
متن کاملRegularization parameter estimation for feedforward neural networks
Under the framework of the Kullback-Leibler (KL) distance, we show that a particular case of Gaussian probability function for feedforward neural networks (NNs) reduces into the first-order Tikhonov regularizer. The smooth parameter in kernel density estimation plays the role of regularization parameter. Under some approximations, an estimation formula is derived for estimating regularization p...
متن کاملVariable Regularization Parameter Normalized Least Mean Square Adaptive Filter
We present a normalized LMS (NLMS) algorithm with robust regularization. Unlike conventional NLMS with the fixed regularization parameter, the proposed approach dynamically updates the regularization parameter. By exploiting a gradient descent direction, we derive a computationally efficient and robust update scheme for the regularization parameter. In simulation, we demonstrate the proposed al...
متن کاملSelection of Varying Spatially Adaptive Regularization Parameter for Image Deconvolution
The deconvolution in image processing is an inverse illposed problem which necessitates a trade-off between delity to data and smoothness of a solution adjusted by a regularization parameter. In this paper we propose two techniques for selection of a varying regularization parameter minimizing the mean squared error for every pixel of the image. The rst algorithm uses the estimate of the square...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Artificial Intelligence
سال: 2001
ISSN: 0004-3702
DOI: 10.1016/s0004-3702(01)00061-3